Mixture-based estimation of entropy
نویسندگان
چکیده
The entropy is a measure of uncertainty that plays central role in information theory. When the distribution data unknown, an estimate needs to be obtained from sample itself. A semi-parametric proposed based on mixture model approximation interest. Gaussian used illustrate accuracy and versatility proposal, although can rely any type mixture. Performance approach assessed through series simulation studies. Two real-life examples are also provided its use.
منابع مشابه
On the Estimation of Shannon Entropy
Shannon entropy is increasingly used in many applications. In this article, an estimator of the entropy of a continuous random variable is proposed. Consistency and scale invariance of variance and mean squared error of the proposed estimator is proved and then comparisons are made with Vasicek's (1976), van Es (1992), Ebrahimi et al. (1994) and Correa (1995) entropy estimators. A simulation st...
متن کاملSimple Equations for Predicting Entropy of Ammonia-Water Mixture
This work presents a set of three simple and explicit equations as a function of temperature, pressure, and mass fraction for calculation of the entropy of the ammonia-water mixture in saturated and super heated conditions. They are intended for use in the optimization and second law efficiency of absorption processes. The equations are constructed by the least square method for curve fitting u...
متن کاملMultivariate Edgeworth-based Entropy Estimation
We develop the general, multivariate case of the Edgeworth approximation of differential entropy, and introduce an approximate formula for Gaussian mixture densities. We use these entropy approximations in a new algorithm for selecting the optimal number of clusters in a data set, and in a new mutual information test with which one can statistically decide whether a distribution can be factoriz...
متن کاملStatistical Wavelet-based Image Denoising using Scale Mixture of Normal Distributions with Adaptive Parameter Estimation
Removing noise from images is a challenging problem in digital image processing. This paper presents an image denoising method based on a maximum a posteriori (MAP) density function estimator, which is implemented in the wavelet domain because of its energy compaction property. The performance of the MAP estimator depends on the proposed model for noise-free wavelet coefficients. Thus in the wa...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Computational Statistics & Data Analysis
سال: 2023
ISSN: ['0167-9473', '1872-7352']
DOI: https://doi.org/10.1016/j.csda.2022.107582